PROGRAMMABLE DEVICE CONTROL SYSTEM AND METHOD 



Field of the Invention 

The present invention pertains to user interfaces for multimedia entertainment 
5 and computing systems, particularly to devices and methods for controlling the various 

components in such systems. 

Background of the Invention 

The home electronics industry, in the midst of an on-going convergence of 
10 televisions and computers, has produced a new class of products, known as PC-TV 

systems, or personal-computer-television systems. In their simplest form, these systems 
allow users to selectively switch between using a video monitor, or display, to watch 
television or to support computer activities, like word processing, creating spread 
sheets, playing computer games, or even surfing the world wide web. A seminal 
1 5 example, the Gateway Destination PC-TV system, from Gateway 2000, Inc., not only 

weds a television to a personal computer, but allows system expansion to include video- 
cassette recorders, laser-disc players, video cameras, direct-broadcast-satellite receivers, 
and so forth. 

Another feature of systems such as the Gateway Destination system is the use of 
20 a remote control, or wireless keyboard, placed some distance from the computer, so that 

users may participate in home entertainment as a family, instead of individually. Due to 
the number of components capable of being connected in such a system, control of the 
various components can become tedious. A graphical user interface displayed on the 
computer screen may allow individual control of the components of the system. 
25 A number of application programs for communication and navigation on the 

Internet and world wide web are in common use, such as Netscape Navigator and 
Microsoft Internet Explorer. These programs or browsers communicate with remote 
computer systems via the Internet or other computer network. When executed, the 
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browser software causes the computer to operate a network communication device such 
as a modem. When browsing the world wide web, a user navigates to different 
environments, known as web pages. On these web pages, any number of features may 
be present, including applets. 
5 An applet is a small application that is often present on world wide web sites. 

Applets are typically also shipped with an operating or a larger product, such as the 
calculator that comes with Windows. Applets on world wide web sites are often written 
in a programming language known as Java. Java is a platform-independent 
programming language. Java programs are commonly referred to as applets since they 

1 0 are most often used for small, transportable programs. 

Applets are commonly loaded into a web browser when a user is navigating web 
pages. The applets may modify their own user interfaces. Applications taking the form 
of software stored on the hard drive of a computer also have graphical user interfaces 
for control of the applications. These user interfaces are modifiable by the user and by 

15 the program as well. Each application or applet has its own individual user interface. 

Each individual user interface of an application or applet may contain a large 
number of functionalities. In certain instances, the functionalities of user interfaces may 
overlap to a small or even large degree. Applications and applets may modify their own 
user interfaces. However, each application or applet has its own functionality setup, and 

20 each application or applet generally has its own specific user interface. The various user 

interfaces are all separate. They do not act together or in a consistent manner. 

Many consumer electronic appliances having screen displays, such as set top 
boxes, televisions, VCRs, and the like, are increasingly being connected to a home 
computer-based audio/video/computer system. An example of such a system is the 

25 Gateway Destination PC-TV system manufactured by Gateway 2000, Inc. Many such 

consumer electric appliances have severely limited on screen display (OSD) generators. 
Further, many of these types of appliances also have no windowing. In the computer- 
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oriented marketplace, OSDs and windowing have become important tools for the 
management of various user preferences for such appliances. 

It would be desirable to provide a graphical user interface having increased 
capability. 

5 Summary of the Invention 

To address these and other shortcomings, the inventor devised an apparatus and 
method of programming a graphical user interface to define and redefine the graphical 
user interface according to functionality of various applications and applets. 

In one embodiment, a software module for programming a graphical user interface 
1 0 is provided. The software module communicates with and is responsive to applications and 

applets, and their individual and collective functionality. Such functionality information 
is supplied by or retrieved from an application or applet, and the software creates, defines, 
and redefines the graphical user interface when a new application or applet is launched. 
A method embodiment of the present invention for defining a graphical user 
15 interface in response to the functionality of an application or applet comprises operating 

or launching a first application, retrieving functionality information of the first application, 
defining a graphical user interface for controlling the functionality of the first application, 
and controlling the first application with the defined GUI. When additional applications 
or applets are launched, the method redefines the GUI in response to additional 
20 functionality information provided by the new application or applet. The new application 

or applet may be controlled along with the previous application or applet 

Another embodiment of the present invention is a shared graphical user interface 
capable of control of a plurality of computer applications or applets. The shared graphical 
user interface is defined and redefined as different applications or applets are launched, by 
25 receiving information from the applets or from software designed to retrieve the 

functionality of the applications or applets 

A machine readable medium embodiment of the invention comprises machine 
readable instructions for causing a computer to perform a method comprising operating a 
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user interface to a first application, retrieving functionality information of the first 
application, defining a graphical user interface for controlling the functionality of the first 
application, and controlling the first application with the defined GUI. A further 
embodiment of the machine readable instructions causes the computer to retrieve the 
5 functionality of a second application or applet launched in the computer, and integrates the 

functionality of the second application into the graphical user interface. The machine 
readable medium may integrate any number of applications or applets into the GUI, subject 
only to the physical limits imposed by the available memory, storage, and hardware. 
Further, the GUI may incorporate functionality of consumer electric appliances, allowing 
10 a programmable GUI for set-top boxes, televisions, VCRs, and the like. 

Other embodiments and advantages of the invention will become apparent after 
considering the accompanying drawings and the following detailed description. 



Brief Description of the Drawings 

1 5 Figure 1 is a flowchart block diagram of a method embodiment of the present 

invention; 

Figure 2 is a flowchart block diagram of a further refinement of the embodiment 
of Figure 1; 

Figure 3 is a block perspective view of a computer system embodiment of the 
20 present invention. 



Description of the Embodiments 

The following detailed description, which references and incorporates Figures 1- 
3, describes and illustrates various embodiments of the invention. An embodiment 100 
25 of a method according to the present invention is shown in Figure 1 . Method 100 

comprises operating or launching a first application or applet on a computer in block 
102, retrieving functionality information of the first application or applet in block 104, 
defining a graphical user interface for the first application or applet on the computer in 
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block 106, and controlling the first application with the graphical user interface in block 
108. The GUI is defined to control the specific functionality of the application or applet 
initialized or launched in block 102. Each application or applet will have functions and 
features which are controllable using the graphical user interface defined in block 108. 
5 Further, the functionality of a consumer electric appliance such as a set-top box, 

television, or VCR connected to a computer system could be programmed into the GUI 
for operation of a programmable GUI for those appliances. 

If another application or applet is launched in block 110, for example by the user 
navigating to another web page, or by the user opening another application or applet, the 

1 0 method 1 00 further comprises retrieving the functionality of the newly launched 

application or applet in block 112, and redefining the graphical user interface in block 
106. For each application or applet launched, the method 100 redefines the graphical 
user interface to integrate the functionality of the new application or applet. 

Referring now to Figure 2, the method of defining the graphical user interface, 

15 block 106, is shown in further detail. When the initial GUI is defined, the functionality 

of the first application or applet is integrated into a graphical user interface for the 
control of the first application, and the first application is registered for each of its 
functions with the GUI. When the function is initiated by the user, any application or 
applet which is registered for the function is notified. 

20 When another application or applet is launched or initialized, as in block 110, 

the newly launched application has its own set of functions and features, and its own 
functionality. The graphical user interface defined in block 106 is not abandoned for a 
graphical user interface for control of the newly launched application or applet. Instead, 
the GUI is redefined in block 106. The redefining of the GUI in block 106 comprises 

25 comparing the functions of the defined GUI to the functionality information of the 

newly launched application. 

In decision block 204, if the function of the newly launched application is 
already defined in the GUI, then the new application is registered for the function in 
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block 206. In decision block 204, if the function of the newly launched application or 
applet is not already defined in the GUI, the function is added to the GUI in block 208, 
and the newly launched application is registered for the function in block 206. The next 
function of the newly launched application or applet is compared in block 202, until all 
5 functions of the new application or applet have been compared and the newly launched 

application or applet is fully registered with the GUI. 

The methods 100 and 106 shown in Figures 1 and 2 are implemented in a 
machine readable medium comprising machine readable instructions for causing a 
computer to perform the method. Such machine readable medium may include software 

10 modules and computer programs. The computer programs comprise multiple modules 

or objects to perform the methods 100 or 106, or the functions of the modules in 
apparatus 300. The type of computer programming languages used to write the code 
may vary between procedural code type languages to object oriented languages. The 
files or objects need not have a one to one correspondence to the modules or method 

15 steps described depending on the desires of the programmer. Further, the method and 

apparatus may comprise combinations of software, hardware and firmware as is well 
known to those skilled in the art. 

Personal computers, such as computer 300 shown in Figure 3, typically include 
a monitor 302, keyboard input 304, central processing unit 306, and a pointing or 

20 selection device such as mouse 308. Further components of a typical computer system 

may include a machine readable storage media such as disk drive 310, hard disk, CD- 
ROM 312, DVD, modem, and the like. The processor unit of such a computer typically 
includes a microprocessor, memory (RAM and ROM), and other peripheral circuitry, 
not shown. Further, consumer electric appliances such as set-top boxes, stereos, 

25 televisions, and VCRs could also be attached to the computer 300. A GUI generated as 

described above could be programmed to allow the user access to the functionality of 
such appliances through the programmable GUI of the embodiments of the present 
invention. 
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Computer programs embodying the invention run on the central processing unit 
306 out of main memory, and may be transferred to main memory from permanent 
storage via disk drive 310 or CD-ROM 312 when stored on removable media or via a 
network connection or modem connection when stored outside of the personal 
5 computer, or via other types of computer or machine readable medium from which it 

can be read and utilized. 

For example, suppose a first application or applet is loaded into the computer 
306. The applet triggers the adding of its entire list of features or functions to the 
graphical user interface, shown as object 314 on the screen of monitor 302. The 

1 0 application or applet is added to the graphical user interface 314, and the application 

registers with the graphical user interface 314 for notification whenever a user initiates a 
command or event to the graphical user interface which calls for any of its functions. 
When a second or subsequent application or applet is initiated, the functionality of the 
newly added application or applet is added to the graphical user interface 314, and is 

15 combined with other application and applet functionality already present in the GUI. 

The application is registered with the graphical user interface to receive notification 
whenever any command or event initiated by the user calls for a function for which the 
new application or applet is registered. When the user actuates commands, the 
appropriate applications which have registered for the commands are notified. 

20 The graphical user interface of the embodiments of the invention overcomes the 

limited OSDs and lack of windowing in many consumer electronics appliances. This 
allows the user to access the functionality of the various appliances which may be 



25 
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Conclusion 

The present invention provides a method and apparatus for creating and 
redefining a graphical user interface to accommodate the functions and features of 
multiple computer applications or applets in a shared user interface. As the user 
5 navigates between world wide web sites containing applets, and applications of the 

computer system, the graphical user interface of the computer is redefined. The 
graphical user interface can be defined and redefined as the user moves between 
different application and applet contexts. Each application or applet registers its 
functions with the graphical user interface, so that when a user initiates an event or 
10 command to execute a function, any application or applet which has registered as using 

that function is notified. 

^4 The embodiments described above are intended only to illustrate and teach one 

H or more ways of practicing or implementing the present invention, not to restrict its 

jjj breadth or scope. The actual scope of the invention, which encompasses all ways of 

}f~ 15 practicing or implementing the invention, is defined only by the following claims and 

ill their equivalents. 
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